A  PERSPECTIVE  ON  ACQUISITION  OF  NASA  SPACE  SYSTEMS 


Oh  s? 

(  'i 

H''-'  C^•^ 

I..’!  r>> 

Dt»  l  x., 

u  - 


(A  Hi 

ooS 

og 

I  ^ 


=  .^u 

S  ■g’M 

n  Z  ^ 
^•HQ 


UNCLASSIFIED 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No.  Or04-01B8 

PtMlo  rapsiting  taunitn  «oi  INs  osllMMn  si  MsuMIsn  k  sstSMM  Is  svsrags  1  Ibik  psi  ra»>)snit,  Mkidlng  ths  Urns  Isr  rsviswing  Intvuollsns,  istraMng  siWPng  Pau  isunst,  gsintiing  sns 
mtinlaliilng  ths  diU  nssdsd,  and  ssinpWIng  and  ravtamlng  tis  estasllsn  al  Msimatlsn,  asiid  sammaiM  ragaidkig  tHs  bmdan  aatlnula  sr  any  sthii  aapsd  st  did  ssiMbn  ot  Msrmailsn, 

Muding  auggaaltona  Isr  nduolng  Ms  budan,  Is  WasNngtan  Hsadguadtn  ■anioaa.  DIracisnit  Isi  Msmiatlen  Opsiallsnt  and  nspsin,  1115  dsPtitsn  Darla  Hlgharay,  gsha  1  (M,  AiUnglsn, 

VA  tIKMPgg,  and  Is  IM  (Mlsa  ¥  Managsmam  and  ■tidgai  Paf  mraia  Radualsn  Pislisl  (0T«44tt5i,  Waamnglsn,  DO  50503. 

1.  AQINCYUllOMLV^ddydbWdi; 

».  REPORT  DATS 

December  1992 

1.  REPORT  TYPE  A 

Final  Repo 

NO  DATliB  COVERED 

rt.  Oct  1991  -  Dec  1992 

4.  TITtE  ANOEUBTm.E 

A  Perspective  on  Acquisition  of  NASA  Space  Systems 

6.  PUNDINQ  NUMBERS 

IDA  Independent 

Research  Program 

e.  AUTMORtl) 

J.  Richard  Nelson,  Karen  W.  Tyson,  and  Daniel  M.  Utech 

7.  PBRPORMINOORaANaA'nON»lAMI(E)ANDAOOREtS(IS) 

Instihite  for  Defense  Analyses 

1801  N.  Beauregard  Street 

Alexandria,  VA  22311-1772 

B.  PIRFORMMaORQANaATUN 

REPORT  NUMBER 

IDA.D-1224 

•.  •PONSORIN(UyiONITOMNaAaiNOVNAMI(R)ANOAOOnaM<M) 

FFRDC  Programs 

5109  Leesburg  Pike 

Suite  317 

Falls  Church,  VA  22041 

10.  flPONBOMNQAIONITORINQ 

AQENOY  RERORT  NUMBER 

11.  lUPPLIMENTARY  NOTES 

13A.  DIETRIRUTION/AVAlUaiUTYeTATIMaNT 

Approved  for  public  release;  distribution  unlimited. 

12B.  DIBTRIBUnON  CODE 

11.  AHTIIACT^MuJrwm«WMW*J 


The  purpose  of  the  work  documented  in  this  annotated  briefing  was  for  IDA  to  understand  NASA’s 
unique  acquisition  process  (as  opposed  to  DoD’s),  develop  preliminary  outcomes  for  space-related 
programs  In  terms  of  cost  and  schedule  growth,  and  explore  issues  related  to  improving  methods  for 
estimating  costs  and  schedules  of  space  acquisition  programs.  IDA’s  initial  findings  concerning  cost 
and  schedule  outcomes  for  NASA  programs  over  the  past  thirty  years  show  that  manned  programs 
generally  show  more  cost  growth  then  unmanned  programs  and  high  schedule  growth  is  associated 
with  high  cost  growth.  Overall,  NASA  space  programs  have  demonstrated  enormous  technical  success; 
however,  these  successes  take  considerably  more  time  and  money  than  comparable  DoD  programs. 


14.  SUBJECT  TERMS  . . 

Acquisition,  National  Aeronautics  and  Space  Administration  (NASA),  Costs, 
Scheduling,  Space  Systems,  Spacecraft 

iii?[>].v  n.rjTTTr— 

■■iKnliflH 

11  PRICSCOOB 

17.  SECURITY  CLABSinOATION 

OP  REPORT 

Unclassified 

IB.  BECURITY  CLASSIFICATION 
OFTHMRAQB 

Unclassified 

11.  SECURITY  CLASSIFICATION 

OF  ABSTRACT 

Unclassified 

tl  LIMITATION  OF 

ABSTRACT 

SAR 

NSN  7M(W), -280.8500 

SM-ioa 


UNCLASSIFIED 


IDADOCUMEN 


II  Research  Ptogram 


PREFACE 


CO 


pi.;-.'. 

S'-"' 

/"•■-•■I 

>:%  '  , 

Wsh'''-' 

a>  o. 

E  V 

g  a 

og  M 
o  E  fl> 
1-  <0  w 

o  2  c 

3  a  « 

"S’®  E 

<l>  (D  2; 

o  n  £ 

«  6 

■o  V  a 

CO  . 
<0  O  (/) 
M  (0  o 
tf}  a  3 
O  O  (/) 
o  L-  .<2 

9“-C  o 
O  4-« 

0)0  0 

>-0  o. 

o  C  K 
O  (0  liJ 


o  ^ 


O  4:5 


i 


n  11 


8  a  I 


8 


C/5 


M 


S  ^ 


rS  S, 


^ 

CX  cl 


6 


.a 


05 


i  R 

tl 

g  -g 

•S 

42  -S 

22  S 


u 

a 

a 


05 


U 


8“ 


t 

I 


a 

•8 

i 


OQ 


JM.u:-r;->;::->"::>v::>'^^ 


cn 

X)  i 

C  W 

•■is 

•i  ^ 

o  — 

k.  x» 
Q.C 

XJ  ® 

£  w 

(u  o 

c'g 

£  g 

CL  P 

£  ffi 

<U  (0 

S'S 

Qo) 

C.£ 

■|i 

■B  CQ 

S2^ 
'□  ^ 
o-g 
o  E 
<5 

<  p 
2r  ® 

2j  Q- 

Z  O 


£ 

o  g 

(0  Q. 

■is  (0 

c  o 
£  ^  c 
S  £  o 
$  (0  ^g 

e'(0  S 

oC  a 

■n  n  X 
^  d)  <D 
<D  II 

■S  ®  ^ 

££  (Q 

8^T3c5 
^  c  c 
C  O  CB 

lig 

r^  0,2 


©  Er<o 

o  “*d> 
j:  o  (0 

j;'o  ® 

E  QiZ 

d>  at! 

<A  M 
<0  <0 
SCO  « 
00  0)  0} 

®  ?l  ®® 

0.2  jz 

ajz  o 

ao  3 

CO  CO  <0 


O 

z 

<Si 

z£ 

^0) 

•O  (0 
c  0) 

1^ 

sg- 

S-s 

S‘5 
<0  o- 

..  o 
(0  (0 
0>  o 

o>£ 

o 

O  2 

£2 

C  O 

oS 

.1C  c 

W  o 

3  8 


s  = 

<  CO 


The  discussion  of  the  NASA  acquisition  process  covets  two  major  areas,  history  and  the  process  today.  In  the  historical 
section,  we  describe  the  evolution  of  the  acquisition  process  over  time,  including  the  structured  program  planning  system  and 
budget  trends.  Next,  we  describe  the  decisionmaking  process  as  it  is  today,  including  budgeting,  acquisition  strategy,  and 
program  review. 
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The  history  of  NASA  ctHitracting  evolved  along  with  the  rest  of  government  contracting.  The  World  War  II  experience 
real  influence,  as  the  government  did  much  more  contracting  than  it  had  in  the  pasL  Government  agencies  wanted  access 
real  capabilities  of  die  fwivaie  sector  [2]. 

Because  of  the  pressure  to  procure  items  quickly,  the  Depaiiment  of  Defense  and  other  government  agencies  began  to 
bimal  advertising  in  favor  of  negotiated  contracts.  The  1950s  campaign  to  close  die  missile  gap  widi  the  Russians  created 


technical  direction?  Should  government  or  the  private  sectm'  integrate  the  systcml  NASA  had  the  capability  to  do  its  own 
integration  fcH-  some  systems  and  (rften  used  it 


Formal  Phased  Project  Planning  established  October  1965 
Project  Approval  Document  required  for  systems  (1968) 
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The  ^ce  shuttle,  intended  to  be  a  quick-turnaround  system,  experienced  peifonnance  ^ortfalls.  The  cost  and  schedule 
overruns  on  the  shuttle  diininished  support  for  oth«-  NASA  programs.  In  1986,  the  Challenger  accident  shocked  the  nation  and 
resulted  in  a  hold  for  manned  space  launches.  Some  pa^oads  associated  with  these  manned  launches  bad  to  be  modified  to  go  on 
expendable  launch  vehicles.  The  ^ace  community  had  time  to  reflect  on  the  causes  of  the  tragedy  and  to  improve  safety 


Budgeting  struggles 

-  Growth  In  1986-1991 

-  Budget  may  grow  by  less  than  inflation  in  future 
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Funding  for  NASA  began  modestly.  At  its  founding  in  1958,  NASA  was  the  follow-on  to  the  National  Advisory 
Committee  for  Aeronautics  (NACA),  an  organization  that  was  doing  aircraft  technology  research  for  military  and  commercial 
aircraft  As  NASA  acquired  additional  missions,  fimding  built  up  to  nearly  $30  billion  (1992  dollars)  in  the  mid-1960s,  during 
the  Apollo  Program  when  Americans  landed  and  walked  on  the  Moon.  At  this  point  the  U.S.  was  devoting  roughly  4.5  percent 


Many  of  the  challenges  faced  by  NASA  in  acquiring  systons  are  also  faad  by  the  Department  of  Defense  in  acquiring 
weapon  systrans.  An  important  common  Teauire  is  that,  for  the  most  part,  we  are  talking  about  inventions.  NASA  is  noted  for 
being  an  R&D  zgeocy  and  is  expected  to  be  .it  the  leading  edge  of  technology.  The  acquisition  process  often  begins  before  the 
“tiling”  that  is  being  acquired  has  been  invented,  or  even  defined  in  detail  The  process  can  begin  with  a  vi^e  goal,  such  as  “a 
rocket  booster  powerful  enou^  to  send  man  to  the  moon”  but  without  a  roecific  notion  of  what  the  characteristics  of  such  a 


This  section  discusses  the  data  we  have  collected  on  NASA  and  other  space  programs.  It  includes  demographic,  schedule. 
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85  Programs  Total 


N  s  Number  of  programs  with  data  availabie 


of  data  was  divided  into  a  number  of  fields,  defined  as  follows: 


Hie  largest  type  group  is  communications  (21),  which  includes  all  three  user  types — for  example  TDRSS-1  (a  tracking 
and  data  relay  system  for  NASA),  DSCS-2  (a  communications  satellite  for  DoD),  and  the  Intelsat  series  (communications 
satellites  for  Intelsat).  The  database  also  includes  13  systems  such  as  the  Gamma  Ray  Observatory  for  monitoring  earth  fields. 
There  are  7  manned  programs,  because  some  parts  of  Apollo,  sudi  as  the  linear  module,  are  considoed  separately. 
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Major  scope  change  affected  outcome. 


listed  above  are  the  16  [HOgrains  in  our  data  base  \ndi  sufficient  data  to  calculate  both  cost  and  scbeduie  growth. 
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This  section  discusses  the  issues  that  have  arisen  from  our  initial  exploration  of  the  NASA  acquisition  p 
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If  we  look  at  cost  growth  as  it  rotates  to  {sogtam  size,  we  see  that  laigo'  NASA  programs  expoiecce  more  cost  gro 
than  small  programs  but  the  idatiooship  is  not  statistically  agmlkant  (A  pos^le  explaralion  fw  die  positive  relationship  is 
there  are  more,  b^t^-develc^Kd  cost-estimating  tools  available  for  smaUer  programs.  Also,  laiger  pmgiatns  may  present  hi| 


ATP  Year 


NASA  programs  that  began  in  the  mid-  to  late  1970s  have  experienced  higher  cost  growdi  than  eariier  or  later  programs. 
For  programs  with  ATP  before  1970,  average  cost  growfli  (weighted  by  actual  costs)  was  89  percent,  wliile  for  programs  in  the 
1970s,  the  average  was  181  peicMiL  For  programs  in  the  1980s.  average  cost  growth  was  1 12  pocent 


No  clear  patterns  are  seen  when  looking  at  cost  growth  by  program  type.  Manned  systems  tend  to  grow  more  than 
unmanned  programs.  Helds  programs  exhibited  mixed  results,  with  two  programs  growing  more  than  20G  percent,  and  three 
program  with  cost  growth  below  50  percent 


B 


DoD 


The  data  were  insufficient  to  do  a  rigorous  comparison  of  NASA  and  DoD  programs.  The  mean  for  the  24  NASA 
programs  (unweighted  by  program  size)  was  95  percent,  while  the  mean  for  the  two  DoD  programs  (DSCS-2  and  SCATHA) 
was  154  percent  The  diffoence  between  the  two  groups  of  programs  was  not  statistically  agnificant 


Here,  we  look  at  cost  growth  as  a  function  of  the  NASA  Center  that  is  developing  the  prograni.  Programs  developed  at 
Langley  bad  the  lowest  mean  cost  growth  and  programs  developed  at  Marshall,  the  highest  HovrevCT,  die  differences  were  not 
statistically  significant  There  is  much  variability  in  cost  outcomes  that  docs  not  seem  to  be  explained  by  the  Center  involved  in 
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The  initial  effoit  indicates  the  feaability  of  measuring  cost  and  schedule  outcomes  of  NASA  programs.  The  data  we  used 
athered  firom  public  sources.  While  there  are  sdll  difBculdes  of  measurement  to  be  overcome,  it  should  be  possible  to 
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by  type  of  program,  contractor,  or  center); 

Provide  a  benchroadc  to  evaluate  past  and  future  management  strategies  such  as  incentive  contracting,  subsystem 
prototyping,  multi-year  procurement,  total  quality  managerooit,  and  activity-based  costing;  and 

Identify  which  management  strategies  work  consistently  well  and  which  are  less  effective. 


K  need  to  be  defined  to  reflect  the  dollars  available — inevitably,  fewer  than  before.  NASA  will 
cess  with  a  more  disciplined  approach  to  achieving  cost  and  schedule  goals  in  the  future.  NASA 
>e  on  the  cutting  edge  of  technology,  but  achievonent  of  these  new  missions  in  the  current 
more;  it  lequiies  tools  for  esdimtiogbodi  costs  and  schedules  and  management  practices  that  are 
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